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ABSTRACT 

Twenty-nine college unier graduates completed practice 
problems to learn the concept "Trochaic meter", /recei ving either no . 
feedba::k (NF) , correct answer, feedback (CA) , -or" attribute isolation 
f eedb'ack^(AJ) . Subjects recorded their confidence in their answers 
for both practice and test items, along with' the amount of time they^ 
spent studying the practice feedback (in CA and AI conditions). On - ' 
practice items, AI feedback produced greater confidence than NF. The 
subjects' confidence increased'^ after the first six (out of eighteen) 
practice items. More time was spent on -feedback following an 
incorrect response than a correct response, and this difference 
increased as confidence increased. For a correct answer, time 
decreased as confidence increased and overall^' more time was spent on 
AI feedback than CA feedback. For an incorrect answer, this direction 
reversed for AI and CA" feedback ' conditions from medium to high 
confidence. On the test, AI and CA ifeedback conditions had more 
correct answers and higher confidence than th^ control NF group. 
Implications for the design of Instruction are discussed. 
(Author/DT) 
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Abstract 

Twenty-nine college undergraduates completed practice 
problem^ to learn the concept 'Trochaic meter/' receiving 
either \^o feedback (NF) , correct answer feedback (CA) , or 
attribute isolation feedback (AI) • Subjects "recorded their' 
confidence in their answers ,for both practice and test items, 
and the amounf o^ ti«e they spent studying the practice 
f^eedback (in CA and AI conditions),^; On practice items, AI 
feedback produced greater confidence than NF. The subjects' 
confidence increased after the first six (out of. eighteen) 
.pract^ice items. More time was spent on /feedback following 
an incorrect response than a correct response, and this 
differenc^e increased as- confidence Jimcreased, For a correct 
answer, time decreased as confidence l^ncreased and overall, 
more time was spent on AI feedback thati CA feedback. For 
an incorrect answer, this direction reversed for AI and CA 
feedb*ack conditions from medium to high confidence. On the 
test,'AI and CA feedbacic conditions had more correct"* answers 
and higher confidence than the control NF group. Implications 
for the design of*^ ins truction are discussed. 



jttribute Isolation Versus Correct Answer Feedback L-l'l-ects 
on Response "ConL-idence , Latency, and Test Performance 

' This study was designed to,^ test the effectiveness of 
feedback variables in promoting concept lea'rning. The purpose 
of this study was to extend the research done by Kulhavy, 
Yekovich, and Dyer (in press). In addition to correct answer 
feedback] att^ribute isolation feedback was used in the present 
study in an effort to improve concept learning. Additionally, 
the variable of'response confidence, which was used as an^ 
independent variable by KulHavy, et.al! (in j)ress), was also 
measured as a dependent variable in this study. The 
elaboratipn of these and other variables follows. 

The independent variabiles -investigated in this study 
were (a) Type of Feedback, ^Cb) Number of Practice Items 
Completed, (c) Response Confidence, and (d) Correctness of 

c 

Response. .The three types of feedback used were Vttr ibute 
isolation 'CAI) , correct answer' (CA)i and no feedback (NF) . 
Attribute isolation was defined as feedback which immediately 
followed a response, indicated whether the response was \^ 
correct^ or not, and then isolated all of the critical 
attributes of the concept (Merr^l § Boutwell, 1973 ; 
Merrill 5 Tennyson, ^in press; Merrill 5 ' Wood ,/1974 , 1975), 
Correct answer feedback only indicated whether the a^nswer 
was correct without any further elaboration of the criticfal 
attributes of .the concept, as in Kulhavy, et.aL. (in press). 



Attribute Isolation 

^ ; . ' . ■ ^ 3 

The no L'eedl^ia^k 'treatment dLtt'ered L'rom Jthat 'olv KuUiavy, 
et.al. (in press)- in that this group n6t only received no 
feedback, but they. also received no definition of Trochaic ' 
meter. This was done specifically ,to determine i f a ceiling 
effect would result from knowledge lobtaiAed prior to the 
experiment. This group sarved as a' control for prior 
knowledge . ^ " 

The number of pracVice items completed* wlire grouped 
into three levels: items 1,-6.-, items 7 - 1 2 , and items 15-18. 
The items were analyzed by groups because separate analysis- 
of all 18 practice items exceeded the capacity of the 
computer program. 

Response conf ideace^ref ers to the learner's self report 
of his/her confidence . in the correctness of the previous^ 
response on a pracvtice item (Kulhavy, et.al., in press). 
Practice ems confidence served as an indepe/n'dent variable 
inf luenci^ the amount of time spent , -^studying ^ feedback. 
Finally, the learner's, response to an individual 



problem^was identified as either correct or ' incorrect . 

Errors were also treated as an~ independent variable influenci; 

the amount of time spent studying feedback. ^ ^ 

Four dependent measures were recorded. Thes'e were 
(a) Confidence on Practice, (b) Time «5pent on Feedback * ' 
During Practice, (c) Performance on Te4t,, and .(d) Confidence 
on Test. Confidence on practice was measured asi a dependent 
variable which was a function of the type of feedb^ack and- 
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number n( [)ractice items completed. The confidence 
variable is viewed as a dependent or independent variable*, 
depending on the point in time. This warrants further 
elaboration. On two successive pract ixe 'prob lems with 
feedback, confidence (dependent vari as measured 

on the second problem, is a function of the type of 
feedback rece iVed on the first problem. It is also predicted 
that the dependent variable of confidence will be influenced 
.by the nujabe'r of practice l^t^ems. which have' been completed 
by^the learner. Conf idenctC-^unc t io.ns as an independen t 
variable oa every practicq problem in, that it [along with 
several (|ther independent variables )' influences the amount 
of time which will be spent on feedback. ) 

The sedoncl'. dependent variable, time spent on feedback 
during practice, was a measure (rf how many seconds. each 

individual spent s tudying each . piece of feedback in- the AI 

^ ' . - t 

and CA 'conditions '(Kulhavy, et.al., in press'). 

The dependent vari^able of perf ormanq^e^on the test was 
a simple count of number of correct answers on the test 
(Kulhavy, et.al., in press). 

The dependent measure o f conf idence on the- test itertis 
asked students to state their confidence for each of their 
response^ on the test, just as they had done on practice 
items (Kiflhavy, et.al., in pre,s^) . The test measured the 
ability to learn the'coacept, as opposed to memory or rule 
using ability. ^ 

^ 8 \ • ' . 
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'I'hc t.'irst oxtcnsion o( Ku 1 liavvj . ;i 1 . , (in pt'osti) 
on the dependent variable., A concept test retpiirin^ 
lUcMi t L L' Lcat Ion oV previously unencoun to red instances 
replaced the memory level test wlilcli contained tlie same 
Lteins as used during practice. Tliis change was made to 
e.vtend tlie gene ral i zab i 1 1 t-y of the results to^ concept 
learning fMcrrill w Tennyson, in press). 



The second extension was vhe addition of the attribute 

i!?olation feedback condition. Attribute isolation feedback 

has been shown to produce better performance on tests- than 

dbrrect answer feedback (Tennyson, Steve, 5 Boutwell, 1975; 

Young, ]L972), and it has also produced mor'e efficiency in 

learning and test performance- (Tennyson, et.al., 1975). 

{y For this study it is hypothesized th^t: . 

1(a). AI feedback will produce higrter confidence 

on practice items than CA feedback. Both of these 

conditions are expected to produce higher confidence than 

^ theNFconditiC)n. f 

1(b). Confidence will be lower for practice items 

1-6, than 7-12 and 13-18; and confidence will be lower for 

practice items 7-12 than 13-18. 

1(c). There wilt'^be an interaction between the type 

of feedback and the number of practice items completed. 

As the number of practice items completed incre'ases, 

* 
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con t* i dtMK't* will iiurtMsr move ioi Al than i^A t'l^rdhack 
conditions, ^uid con f LdcMici* will he lowest Tor the Nl* 
condition. ^ /' 

2(a). MorcN time will he spent on t'eedhack during 
{) ract ice ai* te r :m i nco r rec t res{)Orfi5e , than, a co r rec t 
response (Anderson, Kulhavy, Ti Andre, J 97 1; Kulhavy, et.al., 
I n press ) . 

2(b). The AI condition will spend more tune on 
feedback than the CA condition. 

2(cJ. There, will be an interaction between confidence 
and correctness of response ,. w i th ao di^fference between ^ 
correct and incorrect responses ^tor low cjonfidence, a 
difference between correct responses for medium confidence, 
and an even greater difference for high confidence. 

3. The AI feedback group will have more correct 
answers on the test than the CA feedback group and the CA 
feedback group will have more correct answers than the NF 
group. 

4. Confidence on test items, will be highest for the 

AI ^^^group., lower for the CA group, and lowest for the NF group 

Me thod 

Task . The task for -this study was the classification 
of segments of poems (ranging from one to five. lines in 
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l(Miy.lli) a*. <M t lu- I tiiuliau oi not tiorliaii . Mm* pornr. 

WtM(^ CtMlttTtul 1)11 H^-, X II i lU ll [ilt'tT'. o\ |).lj)Cl'. Thr lll'.t 

\)Ay\r o t" I In- iM.i t tM' I a 1 .r.kcul ^i \ \\c 1(Miium- alrciilv kwcvj Imw 
to sciu tor |n)(M I c iit^ LtM* . I'hv next tliitM^ patM^s wtMt^ t lu* 
dirtHtioiis and a [Ki^r (* x p 1 a i in ii { he i in[)o r t a iic of" rlic 
s t ud V . In A 1 and i^A toedl)ack t roa t iiumi t , \ he tilt li 

|)ak;r v;avi» directions for dt* t cmiu i n i n^ it a poiMii was triuliaic 
(l-ii^iiro 1).^ riie no L'ccdhac k , cond i t i on did not. Iiavo tli\s 
|)ai;o. Tlie next i)ay;e (in all conditions) i;ave direct vons 
l"()r recording; time data in ininutos and seconds. 
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Tlien tlie practice [)oems followed. • Tlie two questions 
following eacli poem were (1) "Is this poem trochaic''" 
"followed by a box witli " +• - over it as a reminder tlvat 
the directions had stated tliat a was to be put in the box 

if the poem was trocliaic and a "-" was to be put in the box 
if the poem was not trochaic; and (2) "How sure are you?" 
followed by a hexagon with "1254" over it as a reminder that 
if you guess'ed the answer, mark "1," if you were somfewhat 
unsure of the response, mark "2," if vou were somewhat sure, 
mark "3," and if. you were confident of your answer, mark "4." 
The upp^r right corner of ev^ry page had a box to mark the 
tijjje when each page was started. In the AI and CA feedback 

* ■ 11 ■ * 
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t I (• .1 1 lilt* n I f .u' h p 1 M I t 1 I p* ) (Mil w .1 1 1 > I 1 > )u (m1 I> \' .1 I) 1 ,1 II k p 1 (• 

[).ipcr Iti^ pi(*V(Mit t hf ItMiiu'i Mom rc.iilin>: I In ouy.h tin* 
p.itM* to I h(* .iir.wcr) a P'Ivm* oI ttMMlb.uk. ' , 

lollowiiii: I lu' ''(M .i;h t (MMi ]>i\n'tirt^ I I (MM-. ( Im M ])n'.itiV(* 
' I n-. I .iiu (♦ li.»ir lU'wiyk t 1 nr. t.mt(^». iMiuloin!;/ oinU'itMl 

;Uui V.lV(Ml t O .1 1 1 r ItM I IlUMl t S III \\\Al nvArV], was .1 ]KllM' . 

st.it iiiv; ih.il 1 >'.li t (M>n Ic'.I potMir". wer'r to tolh>w .nul .i 
rr'|)(' t I I ion of t lu* aiul " " d i rt*^' t i oii:; ioi \ k.' M \ 

\l the pot.Mii was trDcti.ii*." -iiul tlir riMiTidcru'r scale "1J34:" 
'Vov the two fot^dback cdiuI i t i on s , t!ic next pay;e iiuiiCattMl 
that the ilirections ])at:e (l-ivMire 1) was to be returned to 
the b'ooklet at this time aiul not used on the test. rime 
directions; were repeated on the riext p.ige. Liij^hteen 
randomlv ordered (same order used in all conditions), 
[)reviously unencoun t e r ed test items followed. The last 
page indicated that it was the pnd of the program and had 
a place for recording the last time data. 

The poems used were taken from Osguthorpe [1975), 
Merri 1 1 arfd- Tennyson (in press), andWoolley (19"1). 
Wherever^ data were available, an effort was made to include 
six easy, six medium, and six hard instances (half each 
of positive and negative instances) for the 'practice and 
test items. The instance probabil i^y^ analys is of Woolley 
',fT9 7l) was used for this data. Tlie mixture of easy, medium, 
and hard instances was used based on the results of^the study 

'12 
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' by Merrill and' Tennyson CNote 1) which showed that. correct 
classificatioiiv resulted more often under' these , conditions 
than when any othex comb'inatiofi d'f^ difficulty of instances . 

was used. . . ^ . • 

.. ■ * • ' ■ 

Apparatus . . The booklets were held together by one-inch 
rings s'o the pages could .be f lipped^ over . An electronic . 
digi.tai clock presented the time in one-inch n-umbers 
illuminated in "re^ The clock displayed hour, minute and 
second. 

Treatments . .Three treatments were used to investigate 
the hypotheses given in the introduction of this study. . The 
attribute isolation (AI) feedback treatment group receiv'ed 
detailed feedback which pointed out the critical attributes. 
The feedback for the AI treatment had this key in the upper 

left corner: = stressed syllable, '/ = division between | 

feet,Q\ P= a trpchaic foot. In the poem itself, the 
syllables were hyphenated , the stressed syllables underlined, 
thee? feet divided by slashes i an^^he trothaic feet (stressed 
sylTable- followed by unstress,ed syllable) circled. (Seef 
Figure 2.) A statement was then made as to' whether most of the 
feet in the poem were trochaic or were not trochaic and a " + " 
. or was in the box beTow the appropriate statement that 

"This poem is trochaic*^ or "This poem is not trochaic." • 

13 - 
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The doTTa^t answer. (CX) treatment simpl/ had the poem 
retyped on the feedback page along with th^ statement "This 
poem is trochaic" -or "This poem is not trochaic." The box 
be.low had the appropriate "+" or "-"' in it. The finals 
treatment »group received no feedback on the practice item3. 
One practice poein immediately followed another . 



Insert Figure 2 about h^re 

^ 4: ■ ^ — 



Test. Immediately following the ^^treathients , each 
student began the test. The eighteen une)ncountered test 
items were scored as correct or incorrect 'classificatipns 
of. thje poem as trochaic,. Time data, were recorded in the »r 
upper right corner of every -page. No feedback was given 
during the test -and no ^^rections could be used to help 
answer the question "Is this poem trochaic?" The test ^ 
items were written in the same format as the practice items. 

Procedure . All learners received the. treatment as a 
group in a one-hour block of time. The^ clock was displayed 
prominently in the front of the room. Three different 
treatment conditidns were stacked ih an alternating 'AT, CA, 
NF order, so that when they were distributed, there would 
be approximately th6 same number of students receiving . 

(J . 

each treatment. The s tudent s were directed to put everything 
away except for a pencil. "The booklets were then passed 
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out . and ^he following directio'ils were read aloud by 
the experimenter. 1 

"Put your n^me and your professor's name on 
the top sheet/'Of. the' paper so you will 
i:^ceive credit- for participat^irtg in the 
experiment. Cdrcle your class standing. 
Turn, the pag^ and answer the question, "Do 
!you know how to- scqn for poetic meter?" 
tot the purposes; q£ this research study, 

' ^ four things are very important: (l)'^do not 

■■■ ■/ - ' 

• ^; - > look dt anydrte else's paper, (2) Answer all 

■ ' * 

questions as beist^you can,^'^but answer 
everything, (3) record time accurately, and 
/(4) do not turn back once you have turned 
/ the page. Work ''steadily, you will have all 
.the ti^me you need. Now "try « recording the 
time on th;^s qlock for practice. 
(Experimenter writes time on board and 
2^ explains hour, minute, and second division 

where the time data is recorded.)^ When 
you have 'finished, clo se your bookl,et and 
^ sit quietly until everyone is finished. 

Are there any questions? Begin." 
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When the last student finished, the booklets were 
collected and the students were debriefed oh the study.. 
Because of the size* of the room and the manageable number 
of students, the, experimenter was able to -watch carefully 
to ensure that no one looked back through the instruction 
during the 'experiment , and that direction .pages were put 
away before ' taking the test. - ' ■ j 

Pes ign / This study can be broken down into 'three ^> 
interrelated designs.. The first corresponds with hypotheses 
^ (a) , (b), and (c) . The second is based on hypotheses 2(a), 
(b) , an^^) . The third design is for hypotheses 3 and 4. 
All three designs follow the Campbell and Stanley (1963) 
posttest only control grt)up design. The NF treatment serves 
as- the control group. ^ - 

The first design analyses the effect of type of 

■ y „^ ■ 

feedback and number of practice jtems completed on confidence 

in practice items. It vis a 3 x 3 repeated measures design 

with three levels of feedback (AI, CA and/ NF) , th^e levels of 

practice - (items 1-^6, 7-12, and 13-18), and the repeated 

measure 'is across subjects per group (lO in AI feedback ^nd 

NF groups, and 9 subjects *in^ the CA feedback group). ' The 

dependent variaJ^le was the sub j*ects ' confidence on the 

practice items. A univariate- analysis of variance was 
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performed-.' Newm^.i-Kuels tests were used to interpret 

the feedback aiid praptice ef feats .becayse the model 

ijicludfed the random factor of subjects. The Newman-Kuels 

tests compared Al and. CA feedback versus NF, AI verstis 

CA 'feedback; and practid^ items 1-6 versus 7'-12 and 13-18, 

7-12 versus 13^-18. ' " ^ " ' , . 

■. For the second spt of hypcftheses (tfme on feedback as 

a function of .confidence , correctness . of respon^, and type 

-of feedback) a 2 x 2 x 3 design using univariate analysis 

of variance' was performed on data which had beei^ transformed 

with a square root function.^ This .transformation was 

necessary^ because the cell sizes^|(^ried from 11 to 94. 

There were two levels of feedbac.:^ (AI and CA) , two levels 

of correctness of response (incorrect and correct on any 

one item) and three levels of confidence !i(Low, Medium, 

and High, corresponding to confidence ratings of 1 and 2 

combined, 3, and- 4; respectively) Planned comparisons' 

were run which compared AI versus CA; incorrect versus 

correct;" and low versus medium and high, medium versus 

high. Thfe dependent measure for this liypothesis was 

number of seconds, spent on feedback during' practice . 

■ Th-e third hypothesis (t^st performance as a function 

of the type of feedback) and the fourth hypothesis 

(confidence on test items as a function of the type of ' 
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feedback) were analyzed together ' with the same design. 
A multivariate analysis of variance- with three levels of 
feedback (AI , CA, and no feedback) and two, dependent 
variables (number o.f errors on test and confidence on test) 
was performed. Two univariate analyse-s of variance were 
run Cone on each dependent variable) and used to ^interpret 
the .univariate analysis of variance results. Planned 
comparisons were run with the univariate . tes ts , comparing 
AI and CA versus NF, and* AI versus CA feedback. All 
analyses accounted for any missing cells, due to the unequal 
N's in the treatment conditions'. 

Subjects . Twenty-nine college students from ^ introductory 
psychology courses <at Brigham Young University participated 
ia, the experiment, - TheYe were ten students each in the AI 
•feedback and NF treatments, and nine students in the CA 

» 

treatment. The uneven group size was due to the fact that 
one subject failed to appear for tke experiment. All 
subjects completed all of the instruction and the test in 



less than jone hour. 



sis 1 (a) 



Results 



Hypoth!psis 1 C^) stated that AI and CA feedback would 

produce higher confidence than NF on practice items, and 

< 

that AI feedback would" produce higher confidence than CA 

' ' ' f • • 
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feedback. Figure 1 illustrates the means for hypothesis 

1. This hypothesis Vas completely supported . The 

analysis of variance showed feedback to be a significant | 

effect, F(2, 26) = 17,8g4,.p < ,0005.^ Newman-Kuels tests 

showed that AI and CA feedback produce higher confidence 

than^ NF, and st hat AI feedback produces higher confidence 

than CA (a = '.Oil. Jhe main effect means are: 3,433, 

2.821, and-1 . 611 ^for AI, CA^'and NF treatments, respectively, 

0 . . 

^ Insert Figure 3 about here 

— ^ — —■ — - — ■ «... 

Hypothesis ^ (b) stated that as the number of practice 
items completed increased, confidence would inc^rease. • This 
h;ypothesis was a,lso supported (Figure 3). It was tested 
by the planned orthogonal comparisons of 1-6 versus 7-12 and 
13-18, ajid 7-12 versus 13-18,' Practice was a significant 
effect, ¥i2/S2c^) = 3.377, p c .05. The planned comparisons 
show that confidence was higher on the last ^^2 practice' 
items, than on the first 6, F(l, 52) = 6.53, ik< .025. There 
was rfo difference between practice- itejjis 7-12 and 13-18 
F(l,52)^= . 224, p > .05. The respective means were 2.500 , 
2.702, and 2.663. , ' ' ' 

Hypothesis 1(c) stated that theVe would be an\'interaction 
between type of feedback and number of practi?be° items com- * 
pleted. Thii was not supported by the data, Ft4,52) = .354, 
p > .05 (Figure 3) . 
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Hypothesis 2(a) stated that more time would be spent 

studying feedback after an incorrect response, than after a 

) correct response. Figure 4 illustrates the means for 

hypothesis 2. This'^hypo thesis was supported in the direction 

« 

predicted, FCl, 330) = 45. 05 ,-p < .odiOS. The means for 
incorrect and correct responses were-, 4.212 and 3.397^ 
respectively. * , - a 



Insert Figure 4 about here 



Hypothesis- 2 (b) stated that the AI group would spend 
more time on feedback than the CA^group. Theydata also 



r 

'^support this hypothesis, F(l,330) = 10.266, p < . 00-5 



(Figure 4). The means were: AI = 3.999 and CA_ = 3.610. 

Hypothesis 2(c) stated that there' would fe an "interaction C 
between confidence on practice items and. correctness of 
response. This was supported, FC2,330) = 8.536, p < .0005. 

: The orthogonal planned comparisons showed one significant 
effect, F(l,330) = 16.867, p< .0005, i.e., as confidence 
increases , V regardless of th.^ ^XP^ feedback, more time is 
spent on incorrect responses than on correct responses 

. (Figure 4). Tjie^ amount of^time spent on feedback is'^not 
significantly different for correct and incorrect responses 
at low confidence, F(l, 330) = . 285 , p > .0*5; but the time 
is significantly different between correct and incorrect 
responses on'medimm and hi^gh confidence scores. The means 

■ V' ' ■ / ^ ) 

are given in Tabled 1. 4 

; ■ 
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Insert Table 1 about here 

Two additional interactions were significant. These 
were not foreseen, but are reported here because the 
analysis showed them, to be significant. ^oth relate* to 
the. second set of hypotheses which examined the effects of 
type of feedback, correctness of psponse ,' and confidence 
on time spent on feedback/ * 

^ the firsi: significant interaction was between type of 
..feedback and confidence, F(2 , 330J = 1^.611, p < . 005. The 
two planned orthogonal comparisons wei^ significant. The 
first planned comparison indicates that at low confidence 
the AI feedback graup ^^pen^s more time on feedback than the 
Zk feedback group, and t^is time is significantly lower than 
for and' CA feedback at medliiiri and high confidence, 
F (1 , 330) = 7.228 , p < .001. The second ^planned comparison 
indicate'^ that at .medium cohfidence, the AI feedback group 
spends mc/re time -on feedback than the CA group, and at high 
Confidence, this is reversed, F(l,330) = 14.395, p < .0005. 

The, means are given in Table 2. - ^ 

/ 

Insert Table 2 about here 
The second significant interaction is the three-way 
interaction of type of feedback, correctness of response, 
and confidence, as they effect time speniTon' feedback , 
F(2,330) = 4.217, p < .025. Only the sedond planned 
comparison was significant, indicating that t,}>ere was a 
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significant di"S£erenc>^ in the^ interaction o£ type of 
feedback and correctness of response bdtween medium and 
high confidence, F(l,33'0) = 8.220 , p < ^0005. but that 
this interaction was/no^'t significantly ^^^TF^'erent between- 
low versus 5}^ium and high conf iden'ce ,7f (1 , 330) = .270, 
p > .^5. See F^gur®^ 4 fbr the -^raph of the interaction. 

Hypothesis 3 predicted that AI and CA feedback would 
produce better test performance than NF ; and that AI 
feedback would produce better test performance than CA 
feedback. A multivariate analysis of variance was done with 
test, performance and confidence on test (hypo thesis 4 ) as 
dependent variables and type of feedback as the independent 
variable. Univariate analyses were run on the two dependent 
variables to interpret any^ significant multivariate results. 
The first part of this hypothesis was supported. The 
univariate test on performance showed feedback to be a 
significant variable, F(2,26) = 13.317, p < .0005. The 
first comparison (AI and CA ^ NF) was ^significant , . , 

F(l,26) ^ 25.^^r7VND < . 0005. The second comparison 
, (AI versus CA) was n^t significant, Ffl,26) = 1.114, 
p > ,05. The re^s^ctive means- for AI, CA and NF are 
14.700, 13.556, and '9.500. 

Hypothesis 4 state^ that confidence on test items 
would be higher for the AI and CA feedback groups than for 
the NF group; and that confidence would be higher for -the 
AI than the CA feedback group. The multivariate test 

22 
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reported above justifies] a univariate test. Feedback was 

a significant effect q^n conf idence F ( 2 , 2 6) = 7.551 ,* 

p < .005, and the first planned comparison was significant, 

F(l, 26) = 12.223 , p < .05, i'.e., AI and' CA 'f eedbacir\^duce 

higher confidence than NF (Figure 7). The second planned 

comparison (AI > CA) was not significant, F(l,26) = 2.520, 

p > .05. The respective means for AI , CA, and.NF are 

3.390, 2.890 and 2.190. ' ^ 

- . . , " Discus"sion — . ^ 

■ ' ■ ^ • \ ^ ' 

The discussion of this research study is divided into 

three sections relating to the three interrelated design^^. . 

Confidence on ;^ractice items as a dependent ^''ariable . 

The results of the present experiment support two conclusions 

regarding confidence as a dependent variable. pirst,, 

a'^tribute isolation feedback produces higher confidence than 

either CA feedback or RP; .and CA feedback produces higher 

confidence than NF. \^ecdnd, the .learner's confidence 

increases significantly after the first third of practice. 

The support' of, the first two hypothejses measuring confidence 

on practice items indicates that' learner confidence in 

instruction can be influenced by the type of feedback which 

is giVen. These results suggest that AI feedback be used 

to produce high learner confidence in instruction. The 

increase in confidence as practice continued is attributed 

to familiarity with the materials, since the increase in 
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confidence was a constant across all treatments (the type 
of feedback x practice items completed interaction was not 
significant). A feedback x pract^ibe -interact ion was 

initially predicted, based on the idea that confidence 

-ft 

would increase si^ificantly more for-the Maltreatment 
than for the CA^^r NF treatments. The data show that this 
is not the case . 

Time spent on"" feedback as a dependent, variable. The • 
results of the second set of hypotheses (time spent on 
feedback) completely support and replicate the findings of 
Kulha^vy, et.al. (in press). First, the results showing 
that more time was spent on feedback following an incorrect 
response tha^.^ correct response provide an extension of 



the Kulhavy, et.al. (in press) research to a concept level 

task . Addi t ional ly , it was found that more t ime was spent 

on feedback when students were given Af^^feedback than when 

they were ^given CA feedback. This is attributed to the 

fact that, there is more information available, to the learner 

in the AI condition. The third, and most interesting 

finding, also supports the Kulhavy, et.al. (in press) results, 

and follows their "predict ions that if the instruction is not 

*■ 

understandable, the learner will have low confidence, and 
^^edback will be of little help, regar.dless of the 
correctness of the response. For the ^ear.ner who is 
confident^ that the question has been answered correctly, - 
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there is no surprise when, in fact, the feedback confirms 

this expectation, In this case, feedback serves to confirm 

an expectation and a quick ^ance«at the feedback is all 

that is needed. The time when feedback seems to be most 

valuable iSvWhen the" learner is> confident tliat the question 

has been answered correctly, when it actually has been 

answered incorrectly . Thins-^ learner is faced with feedback 

that does not match the expectation. When the expectation 

has not been confirmed , the learner uses the feedback to 

analyze why the error occurred. These results indicate 

that feedback should be* W^itt^n in such a way as to 

anticipate common errors tjaat might be made, and include 

an explanation of these -errors for the confident, but 

erring student'^ since this i^ where feedback splays the 

greatest corrective role. 

Additional findings re: time spent on feedback as 

^ : r- 

a dependent p^riable . The first of the two additional 
significant findings was the^ two-way interaction between 



type of feedback and confidence as measured by time s'pent 

on^ f eedbiftck . At- low confidence, the AI feedback group 

spends more time studying fe^back than the CA feedback 

group and^his time is less than at medium^ ot high 

confidence ratings. The" fact that* t^e AI feedback group 

spends more time studying the feedback than the CA group 
C . - ... 
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follows the main effect* of AI > CA. It also indicates that 
less time is spent on feedback by the unconfident student. 
This is l9%ical since the student with low confidenca. 
probably does not understand the instruction and does not 
spend much time looking at the^ feedback . The unusual-. 
finding here is the significance of the second planned 
comparison. There is a reverse between medium and high 
confidence. At medium ^hfidence, the AI feedback group 
spends more time studying feedback than the CA^ feedback 
group, and at high confidence these groups reverse. It is 
not clear why, at high conf idenc.e , >the AI feedback group 
should spend. less time on feedbacl^.^than the .CA feedback 
group. Looki^ng at the three wa>^ interact ion of confidence, 
type of feedback, and correctness of response may help to 
clarify what is actually happening here. 

Figure 4 shows that this flip-flop of AI and CA 
between medium and high confidence occurs only in the case 
when the learner is incorrect. When the - learner is 
correct the graph is as predicted, i.e.,- time decreases 
as conf iden\:e increases but it decreases more for the AI 
feedback condition which, overall, spends more time on 
f-eedback than CA feedback condition. The/^unexplainable point 
seems to be why the AI feedback group/did not continue 
its increasing trend across levels of confidence when 
incorrect. Since learners spend increasingly more time 
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on feedback after an error, and as confidence increases/ / 
the predicted location of the AT-high confidence point / 
when incorrect wou??l be somewhere above the CA-high / 
confidence point when incorrect. / 

This implies that there is something about a highly 
confident student, who makes an error, and has been 
receiving AI feedback, that allows the utilization of 
feedback to occur more quickly than with students who 
have lower confidence or who have been rece'iving CA 
feedback.. Replication^ p£ thrs study, will determine if it 
is a stable result. ' 

Performance on test as a dependent varible . The 
results f rom^hypothesis 3 indicate that either type of 
feedback QAl or CA) improves test performance over the 
control condition. This is not ^n unexpected finding, but 
it. is not entirely as predicted since' the AI feedback group 
did not perform better than the CA feedback group. 

Confidence on test as a dependent varia bl§^The 

analysis of the data on hypotheses 4 indicates that both 

AI and CA feedback produce higher test confidence than 

the control condition. This was not entirely as predicted 
" . * 

since the AI feedback group did, not have higher confidence 

\, ■ ^ ' 

than the CA feedback group. 
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AI fefedback did not produce significantly better test 
performance or test cojifidence than CA feedback. When 
related back to the previous hypo^theses it can be ^seen 
that AI feedback increases learner* confidence and is 
studied langer by learners,, but the actual test performance 
and confidence ar^e the same fo/r AI .and CA feedback treatment 
conditions, " . ^^^"^^-^ ^ ' ^ 

In the planned replication of this study, some additions 
and changes will.be made'. First, the NF condition will be' ■ 
divided into two conditions: one/will receive instructions 

- • • • J 5 

and no feedback and the other will receive no instructions 
and no feedbacjc: The present study included only the 
latter condition . and . the .inclusion of this ni&w group will 
allow for a comparison of the cont!rol group with the group 
whic^ ^receives only instructions. Second, acknowledge of 
results CKOR) ^ C^igh^/wrong) feedback condition could be 
. added to examine the effectiveness of this type pfi^eedback. 

This was not possible in this study be*cause the natuje of 

\ ■ ^ ■ 

the task meant that any KOR feedback was also CA feedback. 
Third, replication of this study would determine if any ,of 
'•the data were misinterpreted due to the three interrelated 
'designs of this study. In replication, each of the three., 
major hypotheses would be tested with'^'separ^te groups "of 
subjects. Fourth, it would Be interesting, to loolc^ at the 
increase in confidence across practice it^ms with more' 

1 ' • . 28 ^. ' . 



Attribute Isolation 

25 

subdivisions than r-6, 7-1^, and 13-18, perhaps 4 to 6 
divisions. Finally, the confidence scale used in this 
^tudy was a 1 to <t scale, and Kulhavy, et.al. Gin press) 
used a 1 to 5 scale. A replication -of this study might 
include the 1 to 5 scale. . Our conclusions ar^ that this 
.study has provided strong support^.for the Kulhajy, et.al. ^ 
Cin press) results and acids new information by the inclu'sibn 
of the AI feedback treatment and the concept level, task. 

The following is a summary ^o.f the conclusion's of this 
study: / ' 

^ 1. - AI is' g'reater than CA and CA is greater th.an NF , 
for confidence- on practice items. . ^^^^ 

2. Conf idence is higher /^iNihe last 12 practice items^ 
th^n on the first 6.-' / - - ■ . 

^3. More time is^ spent on feedback following _an 
incorrect response tTian . a correct response. 

4. ^ f^lore^time is spent on AI feedback than on CA - ^ 
feedback. . , 

5 . Increasingly more time is spent on an incorrect 
answer \han a connect answer as* confidence increases. 

6. For a correct answer, ^s confidence increases., 
time spent on feedback decreases more for the AI feedback 
condition which, overall, spends' more time on feedback 
than the CA feedback condition. 
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/ > 7. For an incorrect answer, there is a flip-flop 
in the direction oif AI and CA feedback conditions from 
medium to high ' confidence . ' 

8. AI and CA feedback resulted in higher test 
performance than the control NF group. 

9C^AI and CA feedback resulted in higher test 
confidence than the control NF group. 



3. 
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Footnotes 

1, 



Low and medium-low confidence ratings (1 and 2) 
were collapsed into one group be'cause of one cell which 
only had one observation in it. This avoided the 
confo.undlng of degrees of freedom with the cell with zero 
degrees of freedom that would have resulted. 
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Table 1 

Means for the Interaction Effect of Confidence 
on Practice , Items and Correctness of 
Response on Time Spent on Feedback 



Confidence 



Medium 
Low 



Response . 



Incorrect 



3, 795 

4, 492 
4, 348 



Correct 



3, 698 
3, 396 
3, 097 



/ 
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Table 2 ^ 
Means for the .Interaction Effect of Type of 
Feedback and Confidence on Time Spent on Feedback 



Confidence 


Low 


, Medium 


High 


AI 4.176 


. 4.2 98 


3. 5 23 


CA s^S.Sls"* 


3. 590 


V9^/ 
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DIllHCriONS 



WHAT IS pontic METKR? 



Every poem has a certain meter. It Is niilch like the rhythm In music. Juat iia some notea 
are streaaed in music, some syllable^ are streaaed In poetry. These different atress patterna 
determine a poem's poetic meter. There are four types of poetic meter. In this' experiment, 
you will only be required to learn the rhythm pattern of these types: TROCHAIC . 



WHAT IS TROCHAIC METER1 



When a poem is made up of a repeatid pattern of a STRESSED SYLLABLE followed by an 
UNSTRESSED SYLLABLE, we call the poem TROCHAIC. 

IWHAT IS A STRESSED SYLUBLE?! 

A stressed syllable is that part of a word that is said LONGER, LOUDER, OR HIGHER, in 
pitch. Words that 'have only one syllable can often be stressed or unstresaed depending on 
their position in the poetic line. , 



HOW DOES TROCHAIC METER COMPARE WITH THE OTHER RHYTHM PATTERNS?! 



The four patterns are ^listed below. A single repetition of a certain pattern is called 
a "FOOT." The different types of FEET are listed below. You will encounter all four types 
in this experiment, but fou only need to learn the TROCHAIC pattern. 
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1. TROCHAIC^ 



2. NOT TROCHAIC 

3. NOTJIROCHAIC 
^. ,P TROCHAIC 



STRESSED SYLLABLE. UNSTRESSED SYLUBLE 



unstressed syllable, stressed syllable 

stressed syllable, unstressed syllable, unstressed syllable 

unstressed' syllable, unstressed syllable, stressed syllajjle 



Figure 1. Diriections for AI and CA treatments for determining 
iwa poem is trocha'ic. 
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St rcssi'il syl hihli' 
/ - Division bi'twci'ii I'cdt 

4 

o ^ A trochaic foot 



THIS f'OliM IS TROCHAIC 



Figure 2. I\n example of attribute isolation feedback. 
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1-6 7-12' . 13-18 

Number o£ Practice Items. Completed 



Figure 3. The effect of type of feedback arid nufnber 
of practice items completed on practi|:^er. 
item confidence. / . 
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X 



LOW 



Figure 4. 



MED 



Incorrect 



Correct 



5 —I 



4 



3 — 



2 — I ■' ' 



CA 



. HIGH " ' y : , , ■ 'lOW^C^y 

C 0 n f i (feji ^ o,n; ; I}r a^^^ 



MED 



Incorrect 




HIGH 



The effect^vi^f/A(^'irf^ of r^.ponse, type of feedback, 

and conf ide'ftcq ohV^tine spent, on 'f ei^back. ■ ■ ' ^ 
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